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Schur-Weyl duality for orthogonal groups 



Stephen Doty and Jun Hu 
Abstract 

We prove Schur-Weyl duality between the Brauer algebra *8„(m) and the orthogonal group 
Om{K) over an arbitrary infinite field K of odd characteristic. If m is even, we show that 
each connected component of the orthogonal monoid is a normal variety; this implies that the 
orthogonal Schur algebra associated to the identity component is a generalized Schur algebra. As 
an application of the main result, an explicit and characteristic-free description of the annihilator 
of n-tensor space 1/®" in the Brauer algebra Q3n(m) is also given. 



1. Introduction 

Let TO, rt G N. Write A h n to mean that A — (Ai, A2, . . . ) is a partition of ri, and denote by 
£(A) the largest integer i such that A^ ^ 0. 

Let K be an infinite field and V an m-dimensional if-vector space. The natural left action 
of the general linear group GLiV) on y®" commutes with the right permutation action of the 
symmetric group 6„. Let ip,ip be the corresponding natural representations 

^ : (i^e„)°P ^ EndK{V^"), ^ : KGL{V) ^ End^^ (l/^"), 

respectively. The well-known Schur-Weyl duality (see [8] , [lY] , [37] , [IS] , [U] ) says that 

(a) (p(^{K&n)°^) = End^(5£,(y') (y®") , and if to > n then ip is injective, and hence an 
isomorphism onto EndxGL{v){^'^'^) ^ 

(b) ^P{KGL{V)) =EndKe„(T^®"), 

(c) if ch'dY K — 0, then there is an irreducible _ft'GL(F)-ii'(3„-bimodule decomposition 

A=(Ai,A2, ■■■)!-" 
e(\)<m 

where (resp., S"^) denotes the irreducible KGL{V)-module (resp., irreducible K&n- 

module) associated to A. 
There are also Schur-Weyl dualities for symplectic groups and orthogonal groups in the 
semisimple case, i.e., when K has characteristic zero; see [3], [4] and [5 . In these cases, 
the symmetric group will be replaced by certain specialized Brauer algebras. We are mostly 
interested in the non-semisimple case. In [10], Schur-Weyl duality between the Brauer algebra 
5B„(— 2to) and the symplectic group Sp2„i(i^) over an arbitrary infinite field K was proved. In 
[30] ■ the second author gave an explicit and characteristic-free description of the annihilator 
of n-tensor space T/®" in the Brauer algebra *8„(— 2to). 

The aim of this work is to generalize these results to the orthogonal case. We first recall the 
definition of orthogonal group over an arbitrary infinite field K with charfC 7^ 2. Let V be an 
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m-dimensional iiT- vector space with a non-degenerate symmetric bilinear form ( , ) . Then the 
orthogonal similitude group (resp., orthogonal group) relative to ( , ) is 



GO{V) -.^{ge GL{V) 



30 ^ d E K , such that {gv, gw) — d{v, w) 

Vu, w e V 



(resp., 0(F) := [g e GLiV) | (gv, gw) = (v^w), yv.wev}.) 



By restriction from GL{V), we get natural left actions of GO{V) and 0{V) on V"®". Note that 
if ^ d S if is such that {gv, gw) — d{v, w) for any v,w € V, then ((V d^^g)v, {Vd^g)w^ = 
(w, w) for any w, w e Therefore, if K is large enough such that \/d e K for any d <E K, then 
5 e GO(l^) implies that (aidy)g e O(T^) for some {) ^ a ^ K . In that case, 

■^(5) = ^((a^^ idv)(aidy).g) = \dv)i^{(aiAv)g) 
= (a""idv®,i)V'((aidv)g) = a""V((aidv')5)- 

It follows that 

i}{KO{V)) ^il}{KGO{V)) 

provided K is closed under square roots. 

We now recall the definition of Brauer algebra. Let x be an indeterminate over Z. The Brauer 
algebra *B„(a;) over Z[x] is a unital Z[a;]-algebra with generators si, • • ■ , Sn-i, ei, • • • , e„_i and 
relations (see [21]): 

s| = 1, ef = xci, CiSi = ei = s^Ci, V 1 < i < n - 1, 

SiSi+iSi = Si+iSiSi+1, e^ei+iei = e^, ei+ie^ei+i = e,;+i, VI < i < n - 2, 
SiCi+iCi = Si+iEi, gj+ieiSi+i = ei+iSj, V 1 < i < n - 2. 

iB„(x) is a free Z[x]-module with rank (2n — 1) • (2rt — 3) • • • 3 • 1. For any commutative Z[a;]- 
algebra R with a; specialized to (5 e i?, we define 25„((5)fl := R^i,[x] ^n{x)- This algebra was 
first introduced by Richard Brauer (see [3 ) in order to describe how the n-tensor space 1/®" 
decomposes into irreducible modules over the orthogonal group 0{V) or the symplectic group 
Sp{V), where V is an orthogonal or symplectic vector space. In Brauer 's original formulation, 
the algebra Q3„ (a;) was defined as the complex linear space with basis the set Bd„ of all Brauer 
n-diagrams, graphs on 2n vertices and n edges with the property that every vertex is incident 
to precisely one edge. The multiplication of two Brauer n-diagrams is defined using natural 
concatenation of diagrams. For more details, we refer the readers to [26) and [30j. Note that 
the subalgebra of S„(x) generated by si, S2, • ' ' i Sn-i is isomorphic to the group algebra of 
the symmetric group 6„ over Z,[x]. 

The Brauer algebra has been studied in a number of references, e.g., [3], [1], [5], [7], [10] . 
[13, [22], [23], [24], [30], [31], [32], [34], [48]. To set up a Schur-Weyl duality for orthogonal 
groups, we only need certain specialized Brauer algebras which we now recall. Let *B„(m) := 
Z ^n{x), where Z is regarded as Z[x]-algebra by specifying x to m. Let *B„(m)/f := 
if 23„(m), where K is regarded as Z-algebra in the natural way. Then there is a right 
action of the specialized Brauer algebra S„(m)x on the n-tcnsor space V^®"- which commutes 
with the natural left action of GO{V). We recall the definition of this action. Let 5ij denote 
the value of the usual Kronecker delta. For any integer i with 1 < i < m, we set i' — m + 1 — i. 
We fix an ordered basis {wi, W2, • • • , Wm} of V such that 



{vi,Vj) = 5ij', yi<i,j<m. 
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The right action of QS„ (to) on y®" is defined on generators by 

(wji (8) • • ■ «i Wj„ )sj := (g) • • • (g) (g) Uij+i (g) Vi. (g) Wi^.^^ (8) • • ■ Wi„ , 

(8) • • • (8) Wi„ . 

That is, the action of Sj is by place permutation and the action of Cj is by a composition 
of Weyl's "contraction" operator with an "expansion" operator. Let ip be the ii'-algebra 
homomorphism 

^: (»„(m)r^Endi^(l^«") 

induced by the above action. 

Lemma 1.1. [4], [5]) The naturai left action ofGO{V) on V"^" commutes with the 

right action of *B„(m). Moreover, if K — C, then 

^(S„(to)°p) =EndcGO(v)(V^®") =Endco(y)(V^®"), 
^biCGOiV)) = V(CO(F)) = Ends„Mc(^"®"), 

2) if K = C and m > n then ip is injective, and hence an isomorphism onto EndcGO(v) (T^*^") , 

3) if K = C, then there is an irreducible CGO(T^)-Q5„(TO)c-bimoduie decomposition 

ln/2] 

/=0 Ahn-2/ 

where A(A) (respectively, D{X) ) denotes the irreducible CGO{V)-module (respectively, the 
irreducible Q5„(m)-modu7ej corresponding to \, and A' = (A^, Aj, ■ • • ) denotes the conjugate 
partition of A. 

The first main result in this work removes the restriction on K in part 1) and part 2) of the 
above theorem. We have 

Theorem 1.2. For any infinite field K of odd characteristic, we have 

(a) V(^GO(V^)) =End25„(™)(T^®"); 

(b) ip{%^{m)) = End^GO(y) (V"®") = EndKo(v) (^®") , and if m>n, then is also 
injective, and hence an isomorphism onto 

EndKGOiV)iV'^")- 

We remark that the first statement in part b) first appeared in [17] based on a completely 
different approach. The algebra 

5^(TO,n) :=End25„(™)(V^^") 

is called the orthogonal Schur algebra associated to GO{V). Note that we use a different 
definition of orthogonal Schur algebra in Section 2 by defining S'^{m, n) to be the linear dual 
of a certain coalgebra; the two definitions are reconciled in (12. 3|) . Let TZ = Z[l/2]. Let Vjz be 
the free 7?.- module generated hy vi, ■ ■ ■ ,Vm- Let 5B„(to)k be the Brauer algebra defined over 
n. We set 

S^im,n) :=End25„(™)^(V^r)- 
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In the course of our proof of Theorem II. 2[ we show that the orthogonal Schur algebra is 
stable under base change, and the dimensions of both the orthogonal Schur algebra and the 
endomorphism algebra Endxcoiv) (V^®") are independent of the infinite field K as long as 
char if 7^ 2, see Corollary 12 . 71 and Lemma [3.71 We have also the following result: 

Theorem 1.3. Let K be an inGnite Geld of odd characteristic and let OMm{K) be 
the orthogonal monoid dehned over the algebraic closure of K. Suppose m is even. Then 
OMjyi{K) has two connected components, say OM^{K),OM^{K), where OM^{K) is the 
component containing the identity. Both components OM^^ (K), OM^ (K) are normal varieties, 
and OM^{K) is a reductive normal algebraic monoid. In particular, the orthogonal Schur 
algebra S°j^^{m,n) associated to the identity component of GO{V) is always a generalized 
Schur algebra in the sense of fl5| . jl6f . 

When m is odd, the orthogonal Schur algebra S1^{m, n) is in general not a generalized Schur 
algebra. Note that the recent papers [391 140] also study Schur algebras related to orthogonal 
groups. 

As a consequence of Schur- Weyl duality, we know that the annihilator of the tensor space 
y®n ^j^g Brauer algebra Q5„(m) is stable under base change as long as char if ^ 2. Our 
second main result in this paper gives a characteristic-free description of this annihilator. 

Theorem 1.4. Let K be an infinite field of odd characteristic and consider the partition 
of n given by [m + 1, := (m + 1, 1, • • • , 1 ). We iiave that 

n — m — 1 copies 

Ker ip = M)^ ' , 

where A^^^^'^ is the right K[&2n]-nLiodule associated to (m + 1,1"^™^^) as defined 

in the paragraphs below Lemma 16.41 In particular, Ker has a Specht Rltration, regarded as 
K[&2n\-niodule. 

We refer the reader to Sections 6 and 7 for the definition of A^^^^'^ ^ and the action of 
62n on it. 

The paper is organized as follows. In Section 2 we prove the surjectivity of ip. The proof 
is based on Cliff's basis for the coordinate algebra of orthogonal groups and a generalized 
Faddeev-Reshetikhin-Takhtajan's construction. We show that if m is even, then each connected 
component of the orthogonal monoid is a normal variety. This implies that the orthogonal Schur 
algebra associated to the identity component is a generalized Schur algebra. In Section 3 we 
develop a tilting module theory for the orthogonal group Om {K) ■ The main result there is that 
the tensor product of two tilting modules over Om{K) is again a tilting module. As a result, 
we deduce that the dimension of the endomorphism algebra of tensor space 1/®" as a module 
over OmiK) does not depend on K (for charif 7^ 2). Based on the results in Section 3, the 
surjectivity of if in the case where m > n is proved in Section 4 in the same manner as [10] 
Section 3]. In Section 5, we prove the surjectivity of ip in the case where m < n in a similar way 
as [101 Section 4]. In Section 6, we study a permutation action of the symmetric group &2n 
on the Brauer algebra. We construct a new Z-basis for the resulting right S2n-module, which 
yields an integral filtration of Brauer algebra by right 62ri-inodules. Using these results and 
the Schur- Weyl duality we have proved, we give in Section 7 an explicit and characteristic-free 
description of the annihilator of tensor space V'^" in the Brauer algebra 5B„(to). 



SCHUR-WEYL DUALITY 



Page 5 of 



2. Orthogonal monoid and orthogonal Schur algebra 

Let i? be a noetherian integral domain such that 2 • 1/j is invertible in R. Let Xij, 1 < j < 
m, be commuting indeterminates over R. Let An^m) be the free commutative i?-algebra 
(i.e., polynomial algebra) in these Xij, ^ < i, j < m. Let In be the ideal of Aii{m) generated 
by elements of the form 



Xk,iXk',j, 1 < i 7^ i' < to; 

fc=i 

m 

'^Xi^kXj,k', 1<«7^/<to; 
fc=i 

m 



(2.1) 



k=l 



The i?-algebra Aj^{m)/ Iji will be denoted by v4'^(to). Write Cij for the canonical image Xij 
Ir of in A°j^{rn) (1 < i,j < m). Then in AJj(m) we have the relations 



^Cfc,iCfe/j=0, l<i7^j'<TO; 
fc=i 

m 

Ci,kCj,k' =0, 1 < i 7^ j' < to; 

0, 1 < i, J < TO. 



fc=i 



(2.2) 



>o^/s(to, n), where ylji;(m, n) is the subspace 



^^{^k^i^k' ,i' Cj.k^j'.k 
< fe=l 

Note that ^_r(to) is a graded algebra, Aii{m) = ®, 
spanned by the monomials of the form Xij for (i, j) € l'^{m,n), where 

I{m,n) {i = (ii, • • • , i„) | 1 < < to, Vj}, 

I^{m, n) — I{m, n) x /(m, n), x^.j := Xi^j^ • • • Xi^j^ . 

Since Ir is a homogeneous ideal, v4Jj.(TO) is graded too and 

A°R{m) = ®n>oA°R{m,n), 

where j4^(m, n) is the subspace spanned by the monomials of the form Cij for (i, j) G I^{m, n), 
where 



By convention, throughout this paper, we identify the symmetric group 6„ with the set of 
maps acting on their arguments on the right. In other words, if cr G 6„ and a £ {1, . . . , n} 
we write (a)cr for the value of a under a. This convention carries the consequence that, when 
considering the composition of two symmetric group elements, the leftmost map is the first to 
act on its argument. For example, we have (1, 2, 3) (2, 3) = (1, 3) in the usual cycle notation. 

If one defines 

A{xi,j) = ^ Xi^k®Xk,j_, e{xi,j) = 6i,j, yi,ie I{m,n),\/n, 

k^I(m,n) 

then the algebra AR{m) becomes a graded bialgebra, and each Aj?(m, n) is a sub-coalgebra of 
AR{m). Its linear dual 

SR{m,n) := IIomfl(Afl(TO, n), i?) 
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is the usual Schur algebra over R (see |27j ) . Let 

5^(m, n) := RomR{A'}i{m, n), R) 

the orthogonal Schur algebra. It is clear that A'^{m,n) is in fact a quotient coalgebra of 
Aii{m, n), hence S'^{m, n) is a subalgebra of SR{m, n). 

For any integers i,j G {1,2, • • • ,m}, we let Eij denote the corresponding matrix unit for 
Endfl(yR), where Vr is a free i?-niodule of rank n. We define 



l<z J <m 



J, 2' 



E 



For i = 1,2, 



1, we set 

: idy»i-l (g 



.id 



li ■= id 



.id 



By direct verification, it is easy to see that the map which sends Si to (3i and to for 
each 1 < j < n — 1 extends to a representation of *B„ (m) on V^" which is nothing but the 
representation we have defined above Lemma 1.1. By |45l Theorem 3.3] and the discussion in 
Section 5], we know that 



End<8„(„.),(vr) 



Romii{A%{m,n),R). 



(2.3) 



Let i be an integer with 1 < i < m. We define 

m 

deto = ^ Ck,iCk',i' e A^(m, 2) 



fc=i 



By the relations in (|2.2p . we know that deto does not depend on the choice of i. It is well known 
(and easy to check) that detg is a group- like element in the bialgebra A'^{m). Note that the 
relations in (|2.ip are equivalent to 

C* JC = deto J, CJC* = deto J, 



where 



C := (c„) 



J Jnxrti 



J 



/o 




1 

Vi 



i\ 

1 




0/ 

/ nxn 



It follows that (deto)" = det^, where 

ni 

det := ^(-l)^('") 



Cl.w{l)C2,w{2) ■ ■ ■ Cn,w{n) 



k=l 



denotes the usual determinant function. 

Let K be the algebraic closure of K. Let Mm{K) be the set of all m x m matrices over K. 
Then Mm{K) is a linear algebraic monoid over K. We define the orthogonal monoid OMm{K) 
as follows: 

there exists d E K, such that 1 
A* J A = A J A* = dJ. 

The coordinate algebra K[Mm] of Mm(K) is isomorphic to j4;^(m) := (m) 
iC. The coordinate algebra of the general linear group GLm{K) is isomorphic to 
K[xij ,det{xij)^y.^]i<ij<:m- The orthogonal similitude group GOm{K) is defined as 



OM„,{K) -.^{AeM^iK) 



GO,n{K) := GL,„(X) 



there exists d £ K 
A* J A = AJA* 



such that 
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The natural embedding ti : GOm{K) ^ GLm{K) induces a surjective map if : K[GLm] ^ 
K[GOm]- Similarly, the natural embedding io ■ OMm{K) ^ Mm{K) induces a surjective map 
if : K[Mm] -» K[OMm\- We use t2,i3 to denote the natural inclusion from GOm{K) into 
OMm{K) and the natural inclusion from GLm{K) into Mm{K) respectively. Note that GLm{K) 
is a dense open subset of Mm{K), and by [18| (6.6(e)), (7.6(g)")], GOm[K) is a dense open 
subset of OMm{K). Therefore, i2 (resp., 13) induces an inclusion if from K[OM„i] into K[GOm] 
(resp., an inclusion if from K[Mm\ into K[GLm]- We denote by A^{m) (resp., A^{m, n)) the 
image of A-j^{m) (resp., of A-j^{m,nj) in K[GOm]- We define A'^{m) (resp., A'^{m,n)) to be 
the image of ^/^(m) (resp., of Aif(m,n)) under the surjective map K[GLjn\ K[GOm]- 



Lemma 2.4. With the notations as above, the algebra A^(m) is isomorphic to the coor- 
dinate algebra of the orthogonal monoid OMm{K). Moreover, the K -dimension of A^{m,n) 
does not depend on the choice of the infinite field K as long as char K 7^ 2. 



Proof. We have the following commutative diagram of maps: 

GO„,{K) GLraiK) 

which induces the following commutative diagram: 

K[M„,] K[OMra] 



(deto)'[^:r] 



(2.5) 



Since is a surjection, while is an injection, the first conclusion of the lemma follows 
immediately from the above commutative diagram. 

It remains to prove the second conclusion. Let TZ :— Z[l/2]. In ^6j, Section 8], Cliff proved 
that for any field K which is an 7?.-algebra, the elements in the following set 

keZ,0 <k< n/2, [S : T] is 0(m) 
standard of shape A, X\- n — 2k 

forms a if- linear spanning set of A'^{m, n). 

By definition of OMm {K) , it is easy to check that the defining relations (|2.ip vanish on every 
matrix in OMm (K) . It follows that there is a natural epimorphism of graded bialgebras from 
A'^{m) onto A'^{m). Therefore, the image in A'^{m) of the elements in (|2.5p for all n > also 
form a -linear spanning set of A'^{m). On the other hand, since the coordinate algebra of 
GOm{K) is just the localization of OMm{K) at deto, it follows that the image in K[GOm] of 
the elements in the following set 

A: e Z, [S" : T] is 0(m) standard 
of shape A, A h r e 



|(deto)'[5:r] 



(2.6) 



form a Jf-linear spanning set of K[GOm]- If K = C, Cliff proved that (in [6) Corollary 6.2]) 
the natural image of the elements in (12. 5p for all n > is actually a basis of C[OMm], from 
which we deduce that the natural image of the elements in (|2.6p are linearly independent in 
C[GO„,,]. 
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By fO', Chapter II, §5, (2.7)], we can deduce that the algebra K[GOm] has a nice 7?.-form 
TZ[GOm] such that the natural map 

is an isomorphism. It follows that the elements in (|2.6p are always linearly independent in 
ii'[GOm] -^Since K[OMm] is a subset of K[GOm]i we conclude that the image of the elements 
(12. 5p in A^{m) also form a iC-basis of K[OMm] = A^{m). In particular, dimx A^(m, n) = 
dim-j^ A^{m, n) is independent of the choice of the field K as long as char K ^ 2. This completes 
the proof of the lemma. □ 

By Lemma [2.41 for each < n € Z, the dimension of A'^{m,n) is independent of the field 
K. By 18, (9.5)], A^{m,n) = A^{m,n). By (|2.5p . A'^{m,n) has a spanning set which has the 
same cardinality as dmiAf^(m,n). Since A'^{m,n) maps surjectively onto A'^(m,n), and by 
Lemma 12.41 

dim (to, 71 ) = dim^£(TO,rt). 

It follows that the elements in the spanning set (|2.5p form an integral basis of A'^{m,n), 
and thus the surjection from A'^{m, n) to A'^(m, n) is always an isomorphism. It follows that 
A'^(m,n) = A'^{m,n) and A^(to) = A^(to). In particular, we have S'^{m,n) = S'^{m,n) :— 
Hom/f (yl^(m, n), if). Applying (|2.3p . we get that 

Corollary 2.7. With the notation as above, we have that 

1) A'j^(m,n) is a free R-module of finite rank, and for any commutative TZ-algebra K, the 
natural map 

A^im, n)®nK ^ A°i^{m, n) 

is always an isomorphism. 

2) Endig^(„)^ {yn"^ ^ ^"56 R-module of finite rank, and for any commutative TZ-algebra 
K , the natural map 

is always an isomorphism. 

By |18[ (4.4)], GOm{K) admits a graded polynomial representation theory in the sense of 
[181 (1.2)]. Applying (fn (3.2)], we deduce that the images of KGO{y) and of S°ii{m,n) in 
End(V^") are the same. On the other hand, the natural isomorphisms S'^{m, n) = S'^{m, n) = 
Ends„(„)(T/®") imply that the image of S^^(TO,n) in End(l/®") is exactly End,8„(„) (F®") . 
Therefore, we deduce that 

V'(ifGO(F)) = End<8„(„,)(F®"). 
This completes the proof of part a) in Theorem 11.21 It also shows the isomorphism 

5^(TO,n)=End25„M(l/^"); 

so we see that the orthogonal Schur algebra may be regarded as an endomorphism algebra for 
the Brauer algebra. 

From now on until the end of this section, we consider only the case where m = 21. In 
[6l Section 8], Cliff proved that G02i{K) is isomorphic to 02i{K) ^ K as a variety. The 
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isomorphism is given by 

pi: G02i(K) ^ 02i(K) xK"" 

(^A^i{detoA)-\detQA^ , 

where £,i{t) :— diag(f, • • • , t, 1, ■ — , l ),Vt e K. The inverse of pi is given by 

/ copies / copies 

pr': 02i(K) xK"" ^ G02i(K) 

(A,c)^Aa(c). 

In this case, we have that 'K[G02i] =K[02i] ®~K[T,T-^]. It also follows that G02i(K) has 
two connected components in this case. 

As a regular function on GO21 {K) , det^ = detp' . Note that det / deto is also a regular hmction 
on G02i{K). It follows that the two connected components of G02i{K) must be 

GO+{K) : = {A e G02i(K) \ det A = (detov4)'}, 
GO-i(K) ■. = {Ae G02i(K) I det A = -(deto^)'}. 

Note that in this case, det J = — 1, = /2/X2/, JeG02i(K), and we have GO^iiK) = 
GO:^i(K) ■ J ^ J ■ GO^i(K). It is easy to check that GO+(K) is a (connected) reductive 
algebraic group. Let 

0+(K) := S02i(K), 02i(K) J • S02i(K). 
It is clear from the isomorphism pi that 

GO+ (K) - 0+ (K)xK^ GQ-i (K) - Q-^ (K) x K\ (2.8) 

Let 

OM+(K) : = {A e OAhiiK) \ det A = (detoA)'}, 
OM^i(K) : = {Ae OM2i{K) \ dctA = -(detoA)'}. 

Since GO+i(K) C OM+(K), G_0^i(K) C OM-i(K), and G02i(K) is a dense open set in 
OM2i{K), it follows that GO+i{K) (resp., GO^iiK)) is a dense open subset in OM^iiK) (resp., 
in OM2i{K)). It follows that OM2i{K),OM^i{K) are the only two connected components 
0M2i(K), and I21X21 G OM+(K). 

Theorem 2.9. Let x he an indeterminant over K. Then there is an embedding ii'[OM^] ^ 
KlO^i] (8) K[x], and we have the following commutative diagram 

K[OM+] > K[0+]^K[x] 

id ®r , 

K[GO+] -^^K[0+]^K[x,x-'] 

where the top horizontal map is the given embedding, T is the natural embedding K[x] ^ 
K[x,x~^]. The same is true if we replace "+" by 

Proof Let / e ^[O^] ^[x, x'^]. We can write 



Page 10 of [3S] 



STEPHEN DOTY AND JUN HU 



where fi € if [O^] for each i and supp/ :— {i G 7^ 0} is a finite set. From (|2.8p we have 
an isomorphism KlGO^i] ^ A' [O^J (8) K[x, x^^]. One can show that the function on GO^ is 
given by detj,. We identify K[OM+] with its image in i?[GO^], and ^[GOj] with i?[OjJ (gi 

iir[a;, We regard OM^^(K) as a closed subvariety of (AT)'^' . Suppose that / G ^[QA'fj^]. 
This means that / can be extended to a regular function / on OM^iiK). For each element A e 
OM+(K) \ GO^i(K), we know (by definition) that detoA = 0. Since f eJ<[OM^i], there must 
exist an open neighborhood Va of A and two polynomials gA,hA G K[xia, xi,2, ■ ■ ■ ,X2i,2i], 
such that for any X G Va, hA{X) 7^ and f{X) = g^(X)//iA(X). Note that the open subsets 

GO+(K), Va, Ae OM+(K) \ GO+(K) 

gives a covering of OM+{K). Since an affine variety is a Noetherian topological space and 
OAI^iiK) is an infinite set, we can always find an element A G OM^iiK) \ GO^iiK) such that 

Va[]{OM+{K)\GO+{K)) 

is an infinite set. We fix such an element A. We claim that fi=0 whenever i < 0. Suppose this is 
not the case. Let iq < be the least integer such that fig 7^ 0. Then for any X E VaCi GO^iiK), 

hA{X),Ug{X) + hA{X)(^ /»(^)(detoX)'-''«) - (detoX)-^°g^(X) = 0, 

Since GO^ [K) is dense in QM^ [K) , it follows that Va H GO^i {K) contains infinitely many 
points. This means we have the following polynomial identity: 

hAh +hA[Yl /«(deto)'~^°) - (deto)-^''5A = 0. (2.10) 

On the other hand, since Va f][OM^i{K) \ GO^(iir)) is an infinite set, we can always find a 
point B G VAr\{OM+{K) \ GO^(i?)) such that f^„{B) ^ 0. Now we evaluate the polynomial 
identity (|2.10p at B on both sides, we get a contradiction since two of the terms on the left 
hand side of (|2.10p are zero (because deto(i?) = 0) and the other is nonzero. The contradiction 
proves our claim, and also completes the proof of the lemma. □ 

Note that the map 

A ^ AJ, yA G OM-(K), 

defines a variety isomorphism OM^i (K) = OM^i (K) . The following corollary proves the 
statements in Theorem 11.31 

Corollary 2.11. As a variety, OM:^i{K) is normal, and hence OM^i{K) is a (connected) 
reductive normal algebraic monoid. In particular, in this case, GO^i admits a polynomial 
representation theory in the sense of jl8| . and 

S°ji^{2l,n) := Hom^f (I^+(2Z,n),X) 

is a generalized Schur algebra in the sense of JTSf and J16|, where A°j^'^{2l, n) denotes the image 
of Ak{21, 11) in the coordinate algebra KlOM^i]- 

Proof. Since S02i{K) = 0^i{K) is an irreducible smooth affine variety, it follows that 
K[S02i] is a normal domain. By [20[ Exercise 4.18], K[S02i]^K[x] is a normal domain 
too. Let A := 'K[OM+], B := 'K[S02i] «) K[x]. Then the fraction field of A is a subfield of the 
fraction field of B. Now let z be an element in the fraction field of A, such that 

aQ + aiz + ■ ■ ■ + aii-^iz''^^ + z'^' = 0, 
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for some fc g N U {0} and ao,ai, - ■ ■ , ak-i S A. Since B is normal, it follows that z E B. On 
the other hand, note that det = detp as a regular function on OM^i{K), by the definition of 
the embedding A ^ B. From this it is easy to see that a polynomial / = J2iez fi ® B \ A 
if and only if 

/ - 5/detg, 

for some k e Z-*', g e K[xi^i,xi^2, • ■ • , 3^2/, 2/] satisfying detg \ g. It follows that B\Ais closed 
under multiplication. Applying [2] Chapter 5, Exercise 7], we deduce that x Cz A. This proves 
that A is normal. Hence OM^iiK) is normal. Since its group of units GO^iiK) is a reductive 
group, it follows that OM^i^K) is a reductive normal algebraic monoid. It is easy to check that 
£ OM:^i{K) and OM:^i{K) has one-dimensional center. Using [191 Theorem 4.4], we deduce 
that GO^i admits a polynomial representation theory in the sense of [H], and 5j+(2/,n) := 
HouiK {A°j^'^ (21 , n) , K) is a generalized Schur algebra in the sense of [15] and [16] . □ 

Finally, we remark that the same argument can be used to show that the symplectic monoid 
( \18\ . |45j ) SpM2i{K) is also a connected reductive normal algebraic monoid. 



3. Tilting modules over orthogonal groups 

The purpose of this section is to develop a tilting module theory for orthogonal groups. Note 
that in the literature the theory of tilting modules was well established for connected reductive 
algebraic groups, and the existence of a tilting module theory for orthogonal groups was only 
announced in 1 without full details. 

Let K be an infinite field of odd characteristic, K be its algebraic closure. By restriction, 
V becomes a module over the special orthogonal group SOm{K). In this case, V = L{ei) = 
A(£i) = V(£i) is a tilting module over SOm{K). By the general theory of tilting modules over 
semi-simple algebraic groups (cf. |33[ Chapter E]), we know that is also a tilting module 
over SOm{K), and the dimension of 

End50„(7?)(^|" 
does not depend on the choice of the field K. 

Let 9 £ GL{V) which is defined on the basis {^i}]^<j<„ by 

\vi,, if i = m/2 or i = to/2 + 1; , 

0{Vz) = < . , 2 = 1,2, • • • ,TO, 

\Vi, otherwise. 

if TO is even; or 

9{vi) = ~Vi, z = 1,2, • • • ,TO, 

if m is odd. Note that 9 is an order 2 element in 0,„ (K) , and 0„j (K) is generated by SOm [K) 
and 9. 

For the moment we assume that m — 2l is even, and K = K. Let G -.^ Om{K) , H := 
SOm{K). We set 

T:= {diag(ti,--- ,tuti\--- I ti,--- e if^}. 

Then T is a closed subgroup of H . In fact, T is a maximal torus of H . Clearly, 9T9^^ — T. 
Let W := Nh{T)/T be the Weyl group of H. For each integer i with 1 < i < m, let £i be the 
function which sends a diagonal matrix in GLm to its ith clement in the diagonal. We identify 
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a weight Aei + • • • + XiSi E X{T) with the sequence A = (Ai, • • • , A;) of integers. Let sq be the 
generator of the cychc group Z/2Z. There is a natural action of Z/2Z on X{T) which is defined 
on generators by: 

so(A) = (Ai,A2,--- VA = (Ai,A2,-- - ,Xi)eX{T). 

For each Ae X{T)^ (the set of dominant weights), we use L(A), A(A), V(A) to denote the 
corresponding simple module, Weyl module and co-Weyl module over H respectively. If so(A) — 
A, then we let 6 act as id (resp., as — id) on the highest weight vector of A(A). It is well known 
that (see |261 (5.2.2^) this extends tq^a representation of G on A(A). The resulting G-module 
will be denoted by A+(A) (resp., by A^(A)). In this case, 

If So (A) 7^ A, then we set 

A°(A) := Indg A(A), V°(A) Indg V(A). 

In a similar way, we can define L+(A), L~{X) if so{X) — A; and L'^{X) if so(A) ^ A. Using the 
fact that Ind^ is an exact functor and permutes the set of i?-submodules of any G-module 
M, we deduce easily the next lemma. 

Lemma 3.1. With the notations as above, the set 

{Z+(A),Z-(A),i"(A.) I A,A.eX(r)+,.so(A)-A,so(M)^A^} 
forms a complete set of pairwise non-isomorphic simple G-modules. 



If So (A) — A, then we define V+(A), V^(A) to be the duals of A+(— woA), A^{—woX) (where 
■Wo is the longest element in the Weyl group of H) such that 9 also acts as id (resp., as — id) on 
the highest weight vector of V"''(A) (resp., of V"'"(A)). In this case it is also easy to show that 

IndgV(A) = V+(A)e V-(A). 

We shall call A+(A), A-(A), AO(A) the Weyl modules for G, and call V+(A), V-(A), V°(A) the 
co-Weyl modules for G. 



Lemma 3.2. Let A,^ e X(T)+, x,y e {+,-,0}, then 

;[A%x),wy{f,) 



Ext^, 



K, if i — 0, X — fi and x = y; 
0, otherwise. 



Proof First, it is easy to see that if x, y G {+, — }, then 

Hom,(A^(A),V^(,))^(f' = = ^33^ 

V / . otherwise. 



Since Om is a flat group scheme (c.f. [6j 7.2]) over TZ and SOm is a normal subgroup scheme 
of Om (hence SOm is exact in Om), we can apply [331 Part 1, Corollary (4.6)]. We divide the 
proof into two cases: 
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Case 1. so(At) = fi, y £ {+, — }. By [331 Part 1, Corollary (4.6)], wc have 

Ext^ ( A- ( A) , V+ ® Exfc ( A" (A) , V- 



= ExfG(A"(A), V+(Ai) © V-(m)^ 
= Ext^(A-(A),IndgV(A.)) 
= Ext^(Resg(A-(A)),V(A.)) 

\ K, if i = 0, \ = ^, X e {+, -} 



1 0, otherwise. 
With (|3.3p . the above calculation shows that 



Ext^ 



(a-(a),v^(m) 



K, if i = 0, A = /i and x — y; 
0, otherwise, 



as required. 

Case 2. so(m) i/ 0. By [33l Part 1, Corollary (4.6)], we have 

Ext^(A^(A), V"(/^)) ^ Ext'g(A^(A),Ind| V(Ai)) 

= Ext'^(Resg(A-(A)),V(Ai) 

_jK, Hi ^0, fi, X = 
1 0, otherwise, 

as required. This completes the proof of the lemma. □ 



Remark 3.4. Recall that TZ := Z[l/2]. Let H-ji be the 7?,-form of the special orthogonal 
group scheme SOm- We define (cf. [Ml Part I, (2.6)]) Gn := Hn >^ Z/2Z. Let A € X{T) + . 
By the representation theory of semi-simple algebraic groups (cf. [141 Lemma 11.5.3], [331 
Part II, Chapter B]), we know that both the Weyl module A(A) and the co-Weyl module 
V(A) have nice 7?.-forms. We denote them by A-k(A), V7^(A) respectively. Furthermore, for any 
^ e Ar(T)+, V7?,(A) (8) Vuilj) has a V-filtration, i.e., a filtration of i?7j-modules such that each 
successive quotient is isomorphic to some Vk(z^) for some v G X(T)+. The same is true for the 
A-filtration of A7j(A) ® A7^(/i). As a consequence, we can define the i?-forms A^(A), V^(A) 
(x G {+, — , 0}) in a similar way, and Lemma |3 . 2 1 remains true if we replace everything by their 
7?.-forms. 



For any finite dimensional G-module M, an ascending filtration = Afo C Mi C • • • C Af 
of G-submodules is called a A-filtration (resp., V-filtration) if each successive quotient is 
isomorphic to some A^(A) (resp., some V^(A)), where A G X{T)^^x G {+,—,0}. A G-module 
is called a tilting module if it has both A-filtration and V-filtration. 



Lemma 3.5. Let A,^ G X{T) + , x_^y G { + ,-,0}. The G-module A^(A) (g) A«(^) has a A- 
hltration and the G-module V^(A) (E) '^^{fJ-) has a V -filtration. In particular, the tensor product 
of any two tilting modules over G is again a tilting module over G. 
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Proof. Let M := A^(A) (g) A^(/i). By the definition of A^(A) and A^(/i), it is easy to see 
that Res^ M has A-filtration (as H-ji-raodvle) , say, 

= Mo C Ml C M2 C • • • C A/s = Af. 

We set N := Mi. Then N Anii^) for some v € X(T)+. Let N := N + 9N . Then TV is a Gtj- 
submodule of M . It is clear that there is a surjective GTj-homomorphism from Ind^^ (A7^(z^)) 
onto N. We denote it by p : Indg;^ (A7j(i/)) ^ JV. 

Note that both Ind^;^ (Ak(z/)) and iV are free 7^-submodulcs of M. If rank^ Ind^;^ {Aiz{v)) = 
lank-jiN, then it is readily seen that p is an isomorphism. That is, N = Ind^^ (A7j(i^)) as 
G-module. Note that 

Indg-(A7^(^.)) =A«,(^), 

if so(i^) ^ i^; or 

Indg-(A7^(^.)) -A+(z.)eA^(j.), 

if so(i^) = i^. Clearly Res^ (A^) has a A-filtration. Applying [331 Part II, Lemma B.9, Corollary 
4.17)], both M and M/N have A-filtrationSj^so M/iV also has a A-filtration. Now it follows 
easily by induction on dim M that M has a A-filtration as G-module, as required. 

Now we assume that 

rankTj Indgj (A7j(i')) > rank^iV. (3.6) 
Let 01, 02 be the following two maps: 

01 : ON (g)TzC ^ N (g)TzC 02 : ^-r C ^ iV (g)^ C 

where x £ N,c€C Note that 

are two simple S'Om(C)-modules, and 

Resg^(iV(gKC) =im(0i)+im(02). 

Since 9^ — 1, it follows easily that 0i ^ if and only if 02 ^ 0. Therefore, it follows from our 
assumption (|3.6p that so{h') = v and 

Res%l{N (^nC) = Ac{v). 

Therefore, we deduce that as Gc-module, either 

or 

In particular, 9 always acts as a scalar on the highest weight vector of N , and the scalar is either 
l^or -1. This impfies that N = 9N, and hence N N + 9N = N, and either N = A\{v) or 
N = A^(z^), as required. Now using the same argument as before, we can prove by induction 
that M has a A-filtration as G-module. This proves the first statement of this lemma. Since 
every co-Weyl module is the dual of some Weyl module, the statement for V-filtrations follows 
immediately by taking duals. This completes the proof of the lemma. □ 
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Lemma 3.7. Let m be an arbitrary natural number, and K be an arbitrary infinite Reld 
of odd characteristic. Tlien the dimension of 

Endo„(K)(vf") 

does not depend on the choice of the infinite field K. 

Proof. First, we note that 

Therefore, to prove the lemma, we can assume without less of generality that K — K. 
If TO is odd, then 9 acts as — id on the tensor space y^". In that case, it is clear that 

dim Endo„ iK) {vr) = dun End^o^ (k) {v^) ■ 

It follows that (cf. the discussion at the beginning of this section) the dimension of 

Endo,„(K)(vf") 

does not depend on the choice of the field K in this case. 

Now we assume that to is even. We apply Lemmas 13.21 and 13.51 It follows by induction 
through the filtrations that the dimension of 

Endo„(;^)(l/®") 

again does not depend on the choice of the field K in this case. This completes the proof of 
the lemma. □ 



4. Proof of part b) in Theorem \1.2\ in the case m > n 

The purpose of this section is to give a proof of part b) in Theorem 11.21 in the case where 
m > n. Throughout this section, we assume that m > n. 

By Lemma 11.11 and Lemma 13. 7[ we know that 

dimEndo,„(K)(v^") ^ dim'8„(TO). 

Therefore, in order to prove part b) in Theorem ll.2l in the case to > ti, it suffices to show that ip 
is injectivc in that case. Without loss of generality, we can assume that K ^ K is algebraically 
closed. 

Our strategy to prove the injectivity of ip is similar to that used in |10| Section 3]. First, we 
make some conventions on the left and right place permutation actions. Throughout the rest 
of this paper, for any cr, r e 6„, a G {1, 2, • • • , n}, we set 

(a)(crr) = ((a)cr)T, iaT){a) = cr(r(a)). 

In particular, we have a{a) = {a)a~^. Therefore, for any i — (zi, 12, • • • , in) G /(to, n),w G 6„, 
we have 

iw = {ii,i2, - ■ ■ ,in)w = i^^u(l),^w(2),■ ' ' 

which gives the so-called right place permutation action: 
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We make a further reduction. Let V be the same /C-vector space as V, endowed with a 
different non-degenerate symmetric bihnear form ( , )i as fohows: 

ivi,Vj)i := 6ij, VI < i, j < m. 

Then the orthogonal group relative to ( , )i is defined to be 

OiV) [geGL{V) | igv,gw)i = {v,w)i, yv^wev}. 

We fix an element cq e K such that Cq = —1. Then it is easy to see that the following map 

({v,+v,>)/V2, ifl<i<m/2; 
<j) : Vii-^ < co{vi - Ui')/V2, if (to + l)/2 < i < m; VI < i < to, 
[v^, ifi = (m + l)/2. 

extends to an isomorphism from the orthogonal space V onto the orthogonal space V. 
We extend cj) diagonally to an isomorphism (still denoted by 4>) from y^" onto y®". Let 
X e 0{V)J e EndK(y®"). It is easy to see that x e 0{V) if and only if <j)x<j)-^ e 0{V), 
and / e Endp^^^ (T^®") if and only if (j)f(j)~^ G Endo(y) (^'^") • In other words, the map 
(j) : f 1-^ (j)f(j)~^ defines an isomorphism from the endomorphism algebra End^^^^^^ (y®") onto 
the endomorphism algebra Endo(y) Recall that we have a natural map ip from Q3„(m) to 

Endo(v/) (y®") . Using the isomorphism (j), we get a i^-algebra homomorphism ip from 5B„(to) 
to EndQ(,7)(y®") as follows: 

X ^ (/)-V(^)0, VX e »„(to). 

By direct calculation, one can verify that for any i = (ii^--- , i„) g /(to, n), j G {1, 2, • • • ,n — 
1}, 

(Wii (gi • • • (gi Wi„)(^(s-,) := (g) • • • (g) (K) Wj^.^^ (g) Vi^ (g) (g • • • (g i'i„ , 
(wii g) • • • g) Ui„)(^(ej) := g) • • • g) g) f ^ Wfc g) Wfc j Wi^.+j 

(8) • • ■ ® Wi„ • 

To prove is injective, it suffices to prove that ip is injective. This will be done in the rest of 
this section. 

In [25], the Brauer algebra was shown to be cellular. Enyang gave in |21| an explicit 
combinatorial cellular basis for Brauer algebra. Enyang's basis is in some sense similar to the 
Murphy basis for type A Hecke algebra. It is indexed by certain bitableaux. In the remaining 
part of this section we shall use Enyang's results from [21] . We shall only use his basis for the 
specialized Brauer algebra Q5„(to). We first recall some notations and notions. 

Let n be a natural number. A bipartition of n is a pair (A^^-*, A^^-*) of partitions of numbers 
ni and n2 with ni + n2 — n. The notions of Young diagram, bitableaux, etc., carry over easily. 
For example, if A :— (A^^\A*-^^) is a bipartition of n, then a A-bitableau t is defined to be a 
bijective map from the Young diagram [A] to the set {1,2, • • • ,n}. Thus t is a pair (t'^^t^^^) 
of tableaux, where t^^^ is a A^^^-tableau and t*^^) is a A^^^-tableau. A bitableau t — (t^^^ t'^^) is 
called row standard if the numbers increase along rows in both t^^^ and t^^-*. For each integer / 
with < / < [n/2], we set ly = i^f := ((2-^), (n - 2/)), where {2^') := (2, 2, • • • , 2) and (n - 2/) 

/ copies 

are considered as partitions of 2/ and n — 2/ respectively. So is a bipartition of n. Let 
be the standard z^-bitableau in which the numbers 1, 2, • • • ,n appear in order along successive 
rows of the first component tableau, and then in order along successive rows of the second 
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component tableau. We define 

{({,(1)^ t'^') — fd is row standard and the first 
d e &n column of t^^^ is an increasing sequence >. 
when read from top to bottom J 

For each partition A of n — 2/, we denote by Std(A) the set of all the standard A-tableaux with 
entries in {2/ + 1, • • • , n}. The initial tableau t^ in this case has the numbers 2/ + 1, • • • , n in 
order along successive rows. 



Lemma 4.1. (f21]) For each A h n — 2/, s, t g Std(A), Jetm^.t be the corresponding Murphy 
basis element (cf. ^441) of the symmetric group algebra K&^2f+i,--- .n}- Then the set 

< / < [n/2], A h n - 2/, s, t e Std(A)/ 
is a cellular basis of the Brauer algebra Q5„(m)z. 



di*eie3 • • • e2f-imsid2 



As a consequence, by combining Lemma l4Tl and |211 (3.3)], we have 

Corollary 4.2. With the above notations, the set 

< / < [n/2], a e 6{2/+i,. ..,„}, 
di,d2 eDf 



di eies • • • e2f~icrd2 
is a basis of the Brauer algebra *B„(m)2 



From now on and until the end of this section, we shall regard the tensor space F®" as a 
module over Q5„(rn) via (p (instead of ip). To prove the injectivity of fi, it suffices to show that 
the annihilator anntg^^j-^) (T^®") is (0). Note that 

ann2j„(,„)(^®") = f] ann25„(m) (w). 

Thus it is enough to calculate anntg^ („)(«) for some set of chosen vectors v G \/®" such that 
the intersection of annihilators is (0). We write 

ann(u) = amiig^fm) (w) {x G *B„(m) | vx — O}. 

For each integer / with < / < [n/2], we denote by B^^^ the two-sided ideal of S„(m)z 
generated by 6163 • • • 62/^1. Note that B^^^ is spanned by all the Brauer diagrams which contain 
at least 2/ horizontal edges (/ edges in each of the top and the bottom rows in the diagrams) . 

For i g /(to, n), an ordered pair (s, i) {I < s < t < n) is called an orthogonal pair in i if 
is = it- Two ordered pairs {s,t) and {u,v) are called disjoint if {s,t} n {u, w} = 0. We define 
the orthogonal length £o{vi) = ^o(i) to be the maximal number of disjoint orthogonal pairs 
(s,t) in i. Note that if / > ioivi), then clearly B^^'' C ann(wj). 

Lemma 4.3. ann25^(„) (y®") C B'^^\ 

Proof Let x e ann(B^(m) (y®") . Then we can write x ~ y + z where y G K&n, z e B^^\ 
because the set of diagrams with at least one horizontal edge spans S*-^-* (or else see Corollary 
EM- 

Since m > n, the tensor v :^ vi ^ V2 ^ - ■ ■ ^ Vn is well-defined and £o{v) = 0. It follows that 
S^^^ C ann(w). In particular, vz = 0. Therefore vx = implies that vy = 0. 
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On the other hand, smce Vi, - ■ ■ ,Vn are pairwise distinct and y € K&n, it is clear that vy = 
implies that y — 0- Therefore, we conclude that x = z € B^^\ as required. □ 

Suppose that we have already shown anni8^(„) (y®") C B^-^) for some natural number 1 < 
/ < [n/2]. We want to show that ann25„(™) (F®") C Let 



We define 



c:= (1, 1,2, 2,... ,/,/). 

2/+l<6i<---<6„^2/<m] 



If := {b= (&i,- • • ,6„_2/) 
It is clear that £o{vc 'E)Vb) = f for all bElf. 

Following [10| . we consider the subgroup 11 of 6{i_...^2/} ^ permuting the rows of ' 
but keeping the entries in the rows fixed. 11 normalizes the stabilizer &(2f) of t''' ' i^i ®2/- We 
set := S(2/) X n. By [10[ Lemma 3.7], we have 

62/ - U 

where Vf :=D/P|62/, and "U" means a disjoint union. Let Vf ,«2/)|l < *i < 

• • • < 12/ < n}. For each J € Vf, we use dj to denote the unique element in !D/ such that the 
first component of V^dj is the tableau obtained by inserting the integers in J in increasing 
order along successive rows in t"^'^'. Let I'(2/,n-2/) be the set of distinguished right coset 
representatives of 6(2/,ri-2/) in Clearly dj S 25(2/,n-2/)j and every element of T)(^2f,n-2f) 
is of the form dj for some J G Vf. By [10, Lemma 3.8], S/ = Ujep^ T^fdj- 

The proof of the next two lemmas is similar to jlOl Lemma 3.9, Lemma 3.10] except some 
minor changes. For the reader's convenience, we include the proof here. 

Lemma 4.4. Let belf, v = Vc®Vb& y®"^. Let 1 ^ de S„. If either d ^ 6(2/.„-2/) or 
d £ Df, then d~^zeie^ ■ ■ ■ e2/-i G ann(i;) for any z G ^. 

Proof. If d ^ S(2 f,n-2f) ■ Then d~^ is not an element of 6(2 f,n-2f) too. In particular, there is 
some j, 2/ + 1 < j < n, such that 1 < jd~^ < 2f, and hence the basis vector Vb^ with 2/ + 1 < 
bj < m appears at position jd~^ in vd~^ . However, Vb occurs only once as a factor in vd^^ and 
hence for any z G "^,0 ~ vd^^ zCjd-^-i jd^^ is even, = vd^^ zejij-i iijd~^ is odd. As the e^'s 
in 6163 • • • e2f^i commute we have vd'^zeie^ ■ ■ ■ e2/_i = in this case. If d G Vf = D f D 62/, 
then d and hence d~^ as well is not contained in the subgroup of S2/ defined above. 
Therefore there exists jG{l,3,---,2/ — 1} such that jd~^ , {j + l)d^^ are not in the same 
row of t(2^)d-i. Now we see similarly as above that zeiea ■ • •e2/-i annihilates vd ^ for any 
z G □ 



jdj ^6163 • • • e2/-iCTd2 



Lemma 4.5. Let S be the subset 

di,d2 G Df, di ^ 1,1 

a G 6{2/ + l,--- ,n} 

of tie basis i(4.2|) of Q5„(m), and let U be the subspace spanned by S. Then 

beif 
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Proof. Since io{vc vt) = f , it follows that B'-^'^^^ C ann(t;c (Xi Wb). This, together with 
Lemma [4.41 shows that the right-hand side is contained in the left-hand side. 

Now let X e n {(^beif ann{vc<^ Vb)) ■ Using Lemma l44l and the basis ((42l) of S„(-2to), 
we may assume that x — 6163 • • • e2/-i J^deVf "^dd, where v = — {{2^)^ {n — 2/)) and the 
coefficients z^, where d S S)/, are taken from i^6{2/+i.- - .«} ^ K&n- We then have to show 
x = 0. 

Fix bG If and write w = Wc ® Vb- Let A^-^^ , A*^^^ be the Gim-weights of Vc and Vb respectively. 
Since V®" is the direct sum of its GLm-weight spaces, we conclude {vx)f^ = for all /x G 
A(m,n). In particular, 

= {vx)x = {(vc'SiVbjx)^ = ^ (vcCies ■ ■ ■ e2/-i Vb^ Zdd 

d<EVf 

= (jvceies- ■ ■ e2f-i)x{i) <S) Vh)zdd. 
deVf 

By definition, it is easy to see that 

Let us denote this element by v. Then J^deVf Vb}zdd = 0. 
We write d = didj, where di G P/, J G T'/. Then 

{v®Vb)zdd = (u WbZd)^ = (w VbZd)didj = (vdi VbZdidj)dj. 

If J,L E Vf, J ^ L, choose 1 < Z < n with / e J but Z ^ L. Thus there exists an j e 
{1,2,- •• ,2/} which is mapped by dj to I, but {l)d^^ > 2/. Note that for any dEVj 
all basis vectors Vi occurring in vd as factors have index in the set {1,2,- •• ,/}, and all 
those Vi occurring in VbZddj, respectively in VbZdd^, have index i between 2/ -I- 1 and m. 
Let Vi^® ■ ■ ■ ® Vi^ be a simple tensor involved in {vdi ® VbZdidj)dj and ® • • • ® Vj^ be 
a simple tensor involved in (vd2 ® VbZd2dL)dL for di,cZ2 G Vf. Then, by the above, we have 
that 2/ -|- 1 < ji < m, and w^j — Vk for some 1 < k < f . Consequently the simple tensors 
Vi,i € I{m,n) involved in {{vdi VbZdidj)dj} and in {{vd2 (Xi VbZd2dL)dL} are disjoint, hence 
both sets are linearly independent. We conclude that '^^^^^^{vd VbZdd ,)dj = for each 
J € T'/, hence J^di&Vf ^di 'S> VbZd^d., = 0. 

Note that vdi is a linear combination of basis tensors = f (8" • • • (S" Wij/ ) with i e c^'di , 
and that we obtain by varying di through Vf precisely the partition of 62/ into ^'-cosets. 
These are mutually disjoint. We conclude that the basic tensors involved in vdi are disjoint 
for different choices of di e Vf. Therefore, the equality X^dieP/ '^^i ® "^hZdidj = implies that 
vdi (8) VbZdidj = for each fixed di S Vf. Now we vary b&If. The if-span of {w6 | ^ G //} 
is isomorphic to the tensor space V^"~^^ for the symmetric group 6{2/-i-i,- - ,«} — &n-2f- 
Since m — 2f > n — 2/, hence &^2f+i.--- ,«} acts faithfully on it. This implies Zd^dj = for all 
rfi G Vf, J E Vf. Thus a; = and the lemma is proved. □ 

The following corollary can be proved in exactly the same way as in |10[ Corollary 3.11]. 



Corollary 4.6. Let d e'£> f,v = Vf. Then 

B(/)n(p| ann((w,(8)Wfc)d)) = B^^+i) © ( Xdr^eieg • • • e2/-if7d2 j 
keif V / 

where the rightmost direct sum is taken over aU di , d2 G 2)/ such that di ^ d and all a E 
6{2/+i,. ..,„}. ffenceB(/)n (nde»^ae/,ann((we®«6)d)) -Bt^+D. 
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Proof of part b) in Theorem 11.21 in the case m > n: We have seen that 
ann25„(™)(F®") C B^i), and the above Corollary implies that anns„(™) (F®") C pro- 
vided that ann25„(„,)(V^®") C B^f'l Thus by induction on / we have ann<B„(„) (F®") C 
for all natural numbers /. Since 

= for / > [n/2] it follows that annig^^l-TO-) (l/®") = 0. 
In other words, ip and hence if is injective if m > n. By comparing dimension, we deduce that 
if is an isomorphism onto 

End;,GO(y)(^^^") = End^o(y)(V^®")- 
This completes the proof of part b) in Theorem 11.21 in the case m> n. 



5. Proof of part b) in Theorem ] 1.2\ in the case m < n 

The purpose of this section is to give the proof the part b) in Theorem II .21 in the case where 
m < n. Our approach is the same as that used in |10[ Section 4]. 

To prove (p{^n{fn)) = Endj^o(y) (F®") , we can assume without loss of generality that K — 
K is algebraically closed. This is because, on the one hand, the X-dimension of Endx:o(v) (V'®") 
does not depend on the choice of the infinite field K; on the other hand, the /f-dimension of 
ip{^nifn)^) is the same as the .ftT-dimension of (p(*B„(m)/f ). We fix mo £ N such that toq > m 
and mo — m is even. We denote by sOmoiSOm the special orthogonal Lie algebras over C. Let 
5 := sOmoiQ ■= sOm. Recall that TZ = Z[l/2]. Let Uq (resp., U-r.) be the universal enveloping 
algebra of g over Q (resp., Kostant's 7?.-form in Uq). Let q be an indeterminant over TZ. Let 
UQ(g) (resp., V-jz) be the Drinfel'd-Jimbo quantized enveloping algebra of g over Q{q) (resp., 
Lusztig's TZ[q, g~^]-form in UQ(g)). Let Uk := V-ji ®ti K, Uk := Uk ®n K. By putting a "~" 
on the head, we can define similar notations for g. 

Let Vti be a free module of rank mo over TZ. Assume that Vn is equipped with a symmetric 
bilinear form ( , ) as well as an ordered basis {fi,f2, ■ • • j'^mo} satisfying {vi,Vj) = Si^mo+i-j- 
For any commutative TZ algebra K, we set Vk ■— Vjz ®ti K. Let i be the if-linear injection 
from Vk — Vn ®n K into Vk defined by 

m m 
'^kiVi ^ ^A;iWi+(mo-m)/2, V fci , • • • ,km<£ K. 
i=l i=l 

Let TT be the /•C-linear surjection from Vk onto Vk defined by 

mo m 

'^kiVi ^'^ki+(rno-m)/2Vi, V fci , • • • , fc„io ^K. 
i=l i=l 

Then, l induces an identification of g as a subalgebra of g, and also an identification of 
SOm{K) (resp., Om{K)) as a subgroup of SOmo{K) (resp., Omo{K)). Henceforth, we fix these 
embeddings. The following result is well-known (cf. [331 Part I, Lemma 7.16, 7.17(6)]). 

Lemma 5.1. We have 

Endu,(5)(^'r) =EndKSO„„w(V^r), 
EnduK(g)(X^r) -EndKSO„w(V^r)- 

Note that the homomorphism l and tt naturally induce a linear map 
Oo : Y.nAKso,„,(K){vT) ^ End^so^CK) (l^^") 

/ I—!- TT O / O i. 



SCHUR-WEYL DUALITY 



Page 21 ofinni 



By restriction, we get a linear map (again denoted by Qo) from Endxo,„ {k){Vk"^) to 
EndjfO„(A:) (^^") • Note that, 80 is in general not an algebra map. 

Lemma 5.2. We have 

(1) the map 

Qo : EndKso„„(K)(V^D ^ EndKso„(K) (V^D 

is surjective. 

(2) tie map 

Go : End^o„„(K)(V^^") - End^o„(K) (^^^") 

is surjective. 



Proof. We first prove (1). By Lemma [5.11 it suffices to show that the map 

00 : Endu,(5)(V^r) - Endu,(,)(yr) 

is surjective. The same argument used in [101 Section 4] still works (except that we use a 
slightly different embedding g '-^ 5 here). So we shall give only a sketch here. Recall that for a 
module M over a Hopf algebra H, := {a: G M\hx = Ehx, V/i S H}. We have the following 
commutative diagram 



EnduK(I)(l^r) 



«i2ri\UK(B) 



K 



where the two horizontal maps are natural isomorphisms. Therefore, it suffices to show that 

^®2n |^^y«i2n'^UK(g)^ _ (gi2n'^ Uk (s) 

Since (by the theory of tilting modules) all the maps and modules are defined over TZ, it suffices 
to prove the above equality with K replaced by TZ. Let 0]n,M[^ 0]k, S[0], S[0] be the 
notations for g, g which is defined in a similar way as in |10|, Section 4]. We have the following 
commutative diagram. 



(gi2n\UK(B) 



TZ 



T/®2n 



(g)2n\UK(g) 



n 



TZ 



®2n 



TZ 



Hence it suffices to show that the rightmost vertical map is surjective. 
Let 

Jo := |(«i,-- - ,i2n) e /(to, 2n) Wi^ o ■ ■ ■ o w^^^ e B[0]|, 

Jo |(ii, • • • ,Z2n) e /(TOo,2rt) w^^o- • • ow^^,. e -B[0]|, 

where {wi, • • • , Wm} (resp., {wi, • • • , Wm}) are canonical bases of Vjz (resp., of V-jz), "o" is the 
notation in |35[ (27.3.2)], and "0" is the similar notation for g. As in [10[ Corollary 4.5], it is 
clear that the set 

+ M[^ 0]n I in,-- - ,i2„) G Jo} 
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forms an 7^-basis of V^'^'' /M[^ 0]7^, and the set 

jwii (g) • • • (g) Wi2„ + My^ 0]k (ii, • • • , i2n) e Jo} 

forms an 7^-basis of V®'^'' /M[^ 0\n. We set 

■h[{mQ - r7i)/2] := |((mo - m)/2 + n, • • • , (toq - nT-)/2 + «2n) («i, • • • , «2«) e Joj. 

Using the same argument as in the proof of [101 Theorem 4.7], we can sho^wQ that 
Jo[{mQ- m)/2] C Jq. This imphes that 6**^" maps ^"/M[^ 0]^ isomorphically onto an 
7^-direct summand of V®'^'^ / OJtj. It follows that 

as required. This proves (1). 

For (2), we note that if m is odd, then mg is odd too (as mg — m is even). In this case, since 
9 acts as a scalar (1 or —1) on V^", it is readily seen that 

Endxo„„(K)(V^r) = End^so™, w(V^r), 

End^O„(if)(VD = EndKso™(K)(^D- 

Therefore, by (1), we know Qq is surjective in this case. Now we assume that m is even, then 
Too is also even. We have the following commutative diagram. 



End 



KSO„,„(K) 



End 



KSO^(K) 



{vr) 



which implies (by (1)) that 



K 



n^SO^{K) 



(5.3) 



Since 9 normalizes SO,n{K), 9 must stabilize (y®2«^SO,„(K)^ As 6*2 = 1 and 1 ^ -1, it follows 



.o„AK) 



that 9 acts semisimply on (V^^") " with two eigenvalues 1,-1, and (V^^") 
is nothing but its eigenspace belonging to 1. By (|5.3p . tt®^" must map the eigenspace of 
^mn\^SO^g(K) i^g^pj-^gjj^g Y_ surjectively onto the eigenspace of ^y^®2n^-SOm(K) ^g^Qj^gjj^g 

to 1. In other words. 



^®2n 



Now the surjectivity of Oq in this case follows directly from the following commutative diagram. 



End^O„(K)(l^A®") 
This completes the proof of the lemma. 



^(gi2n'^^Om{K) 



□ 



^Note that we get a shift here because we have used a shght different embedding 0^0. 



SCHUR-WEYL DUALITY 



Page 23 of [31] 



Recall that the orthogonal bilinear form on V determines an 0„i(i4r)-isomorphism Vk ^ V^. 
Therefore, there is an isomorphism 

EndK{V^'') ^ ® (Vf ")* = (V®'")*, (5.4) 

such that for any given i — (ii, • • • ,in),j = (ji: ■ ' ' i in) G ^("^, n), the map which sends vj^ := 
f;i • • • (E" to Si^iVj corresponds to the linear function 

Vki <^ Vk2 ■ ■ ■ Vk-2„ ^ <5m + l-ii,fc2„'5m+l-i2,fc2„-l • • • ^m+l-J„,/c„+i 

for any (fci, • • • , fc2„) € -^(to, 2n). The symmetric group 62™ acts on by place permutation, 
hence also acts on (V^^") = Endj^ (V^"). Similar results also hold for Vk (with m replaced 
by Too). 

Let D e Bd„ . Wc can write D = Dij , where 

i = (li, • • • ,?„),i = (jl, • • • ,jn), 

such that (*!, ji, 42, ^2, • • • ,imin) is a permutation of (1,2, 3, • • • ,2n), and for each integer 
1 < s < n, the vertex labelled by is connected with the vertex labelled by js- 

Lemma 5.5. (cf. [IT], [23l Proposition 1.6], [34]) With the notations as above and If 5. 4]) in 

mind, for any wi, ■ ■ ■ , W2n S Vk, we iave that 

n 

(p{Dij){wi (g) ■ ■■ (g) W2n) = n(wj^,u;jj. 

s=l 

Furthermore, ip is a 6 2n -module homomorphism. Similar results also hold for Vk- 

Proof. Let di^eie^ - ■ ■ e2f-iCTd2 be the basis element which corresponds to the Brauer 
diagram D, where / be an integer with < / < [n/2], a € (5{2/+i,- - ,n} and c?i,c?2 G 
lyf := ((2-^), (n — 2/)) h n. Then the top horizontal edges of D connect {2i — l)c?i and {2i)di, 
the bottom horizontal edges of D connect {2i — l)c?2 and (2z)d2, for z = 1, 2, • • • , /, and the 
vertical edges of D connect (j)rfi and {j)crd2, for j = 2/ + 1, 2/ + 2, • • • , n. 

Let i G /(to, ?i). By our definitions of tp and the set 2) /, the action of 

D = d^^eies • • • 62 f-icrd2 

on can be described as follows. Let (ai, 5i), • • • , (a/, 6/) be the set of all the horizontal edges 
in the top row of D, where < 6s for each s and ai < a2 < ■ ■ ■ < aj. Let (ci, di), • • • , (c/, c?/) 
be the set of all the horizontal edges in the bottom row of D, where Cg < ds for each s and 
ci < C2 < ■ ■ • < Cf. Then for each integer s with 1 < s < /, the (cs, ds)th position of ViD is the 
following sum: 

m 

Si^^,m+l-h^ '^{Vk (8) Vk'). 
k=l 

We list those vertices in the top row of D which are not connected with horizontal edges 
from left to right as ik2f+n *fc2/-i-2' ' ' ' 1 Then, for each integer s with 2/ + 1 < s < n, the 
(s(T(i2)th position of ViD is Vi^, . Now it is easy to verify directly that ip{Dij)(wi g) ■ ■ ■ g) W2n) = 
J^"^j^(t(;i^, Wj^), from which we see immediately that ip is a 62n-nrodule homomorphism. □ 

We define a linear isomorphism Qi from the Q3,i(too) onto Q3,i(to) as follows: 
ei(5j"^eie3 • ■■e2f-ia^d2) = di^^eiea • • ■e2f-i(jd2, 
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for each < / < [n/2], Xh n - 2f, di,d2 E D j 



Lemma 5.6. The following diagram of maps 



S„(mo) 
ei 
<B„(to) 



is commutative. 



End 



e 



End 



KO,^{K) 



Proof This follows directly from Lemma [5751 



□ 



Proof of Part b) in Theorem 11.21 in the case m < n: Since mo > n, by the main result 
in last section, we know that (p is surjective. Since Qi is a linear isomorphism, and by Lemma 
15.21 6n is also surjective, the commutativity of the diagram in Lemma 15.61 immediately implies 
that (p is also surjective. This completes the proof of Part b) in Theorem 1 1.2 1 in the case m < n. 



6. The &2n-&ction on 25„(a;) 



In this section, we shall first introduce (cf. [22] ) the right sign permutation action of the 
symmetric group &2n on the set Bd„. Then we shall construct a new Z-basis for the resulting 
right S2n-module, which yields filtrations of *B„(x) by right 62n-niodules. Certain submodules 
occurring in this filtration will play a central role in the next section. 

For any fixed-point-free involution <t in the symmetric group &2n, the conjugate w~^auu of 
(T by w £ &2n is still a fixed-point-free involution. Therefore, we have a right action of the 
symmetric group 62n on the set of fixed-point-free involutions in 62n- Note that the set Bd„ 
of Brauer n-diagrams can be naturally identified with the set of fixed-point-free involutions in 
&2n- Hence we get (cf. [22] . |30j ) a right permutation action of the symmetric group 62™ on 
the set Bd„ of Brauer n-diagrams. We use " * " to denote this right permutation action. Let 
S„ denote the free Z-module spanned by all the Brauer n-diagrams in Bd„. The right sign 
permutation action of &2n on S„ is defined by 

Di.w:= {-lY^'"^D*w. 

We shall adopt the following labelling of the vertices in each Brauer diagram. Namely, for each 
Brauer n-diagram D, we shall label the vertices in the top row of D by integers 1, 2, 3, • • • ,n 
from left to right, and label the vertices in the bottom row of D by integers n + l,n + 2,n + 
3, • • • , 2n from right to left (see Figure 6.1 for an example for n = 5). This way of labelling is 
more suitable for studying the sign permutation action from &2n- 



12345 




10 9 8 7 6 



Figure 6.1 
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For any commutative Z-algebra R, we use ^n.B. to denote the free i?-module spanned by all 
the Brauer n-diagrams in Bd„. Then ^n,R becomes a right i?[62n]-module. Clearly, there is 
a canonical isomorphism ^n,R — R®z which is also a right i?[62Ti]-module isomorphism. 
Taking R = Z[x], we deduce that the Brauer algebra becomes a right Z[x] [62Ti]-module. 

For any 1 < i < 2n, we define 7(1) := 2n + 1 — i. Then 7 is an involution on {1, 2, • • • , 2n\. 
It is well-known that the subgroup 

{w £ &2n I (7(a)) w = j{aw) for any 1 < a < 2n} 

is isomorphic to the wreath product Z2iS„ of Z2 and 6„, which is a Weyl group of type i3„ 
(cf. [29]). 

For any commutative Z-algebra R, let Ir denote the rank one trivial representation of i?[Z2 I 
&n]- By [301 Lemma 2.1], under the right permutation action *, there is a right _R[(32ri]-module 
isomorphism 

^nM = Ind^[^^'"j^] Ir. 
Let SGNij be the rank one sign representation of &2n- 



Lemma 6.1. Let &2n SLCt on '^n,R i^j'a the right sign permutation action " -k" . Then there 
is a right i?[(32n]-modu-/c isomorphism 

^nM = SGNfl,®Ind;^|®7J^] 1^. 

Let fc be a positive integer. A sequence of nonnegative integers A — (Ai, A2, • ■ • ) is said to be 
a composition of k (denoted by A N fc) if X]i>i Ai = fc. A composition A = (Ai, A2, • ■ • ) is said 
to be a partition of k (denoted by A h fc) if Ai > A2 > • • • . The conjugate of A is defined to be 
a partition A' = (A'^, Aj, • • • ); where A^ :— #{i\Xi > j} for j = 1, 2, • • • . Denote by Vn the set of 
partitions of n. For any partition /i of 2n, denote by the associated Specht module over 62n- 
The notion of Specht modules we use here is the same as that introduced in [44'. In particular, 
S-^^") is the one-dimensional trivial representation of &2n: while S'^^^") is the one dimensional 
sign representation of &2n- For any commutative Z-algebra R, we write S'^ := R(E)z S^. Then 
{Sq I /i h 2n} is a complete set of pairwise non-isomorphic simple Q[62n]-modules. 

For any composition A = (Ai, • • • , As) of n, let 2A (2Ai, • • • , 2As), which is a composition 
of 2n. We define 2^1 -.^ {2X \ X e Vn} ■ 

Lemma 6.2. Let &2n 9,ct on S„^q via the right sign permutation action . Then there 
is a right Q[S2ri]-modu_/e isomorphism 

AG2P„ 



Proof. This follows from [HI Chapter VII, (2.4)] (see [31 Lemma 2.2]). □ 

For any non-negative integers a, b with a + b < n, we denote by Bd|^j the set of all the Brauer 
diagrams in Bd„ which satisfy the following two conditions: 

1) for any integer i with i<aoTi>a + b, the vertex labelled by i is connected with the 
vertex labelled by 7(i); 

2) for any integer i with a < i < a + b, the vertex labelled by i is connected with the vertex 
labelled by 7(j) for some integer j with a < j < a + b. 
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Note that one can naturally identify any Brauer diagram D in Bd||^j with an element w{D) 
in &(^a+i,a+2,--- .a+b)- Thus we can attach a sign e{D) := (— to each Brauer diagram in 
Bd|^^\ where £{?) is the usual length function. We define 

yI^^:= Y: <D)D 
For each integer k with < /c < n, we set Y^j,) :— yI'S . 



Definition 6.3. Let A = (Ai, • • • , As) be a partition of n. We define 



We identify S„ with the set of Brauer n-diagrams in 23„ which contain no horizontal edges. 
Let &\ be its Young subgroup corresponding to A. Then we actually have Yx £ &\ C &n C 
For any positive integer k and any composition /i = (/ii, • • • of fc, the Young diagram of 
H is defined to be the set [ii] := {{a, < a < s, 1 < 6 < fia}- The elements of [/i] are caUed 
nodes of /i. A /i-tableau t is defined to be a bijective map from the Young diagram [/i] onto the 
set {1, 2, • • • , k}. For each integer a with 1 < a < fc, we define rest(a) = j — i if t{i,j) = a. We 
denote by f the /i-tableau in which the numbers 1, 2, • • • ,k appear in order along successive 
rows. We denote by the /i-tableau in which the numbers 1, 2, • • • ,k appear in order along 
successive columns. The row stabilizer of P, denoted by 6^, is the Young subgroup of 6k 
corresponding to /i. We define 

Let Wfj. € Sfe be such that = t^. For example, if fc = 8, /i = (3, 3, 1, 1), then 



12 3 15 7 

4 5 6 2 6 8 

7 ' ^ " 3 

4 



i^ = l , t^ = ; , w;^ = (2,5,6,8,4)(3,7). 



For any partition A = (Ai, A2, • • • , As) of n, we define 

A := (Ai, A2, • • • , As, As, • • • , A2, Ai), 
which is a composition of 2n. Let be the Young subgroup of &2n corresponding to A. 

Lemma 6.4. Let A = (Ai, • • • , As) be a partition of n. Then for any w e 63;, we have that 



Proof. Since the elements ^( ) j ^(aIj^ > ' • • ^^(x\^^''^ ps^irwise commute with one 

another, the lemma follows directly from definition. □ 

Let fc be a positive integer and fj, he a composition of fc. Recall that a /i-tableau t is called 
row standard if the numbers increase along rows. We use RowStd(/i) to denote the set of all 
the row-standard /i-tableaux. Suppose /i is a partition of fc. Then t is called column standard 
if the numbers increase down columns, and standard if it is both row and column standard. 
We use Std(/i) to denote the set of all the standard /i-tableaux. 
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Note that every partition in the set {2Vn)' is of the form 

where v := (vi, U2, ■ ■ ■ , Vs) is a partition of n. Now let v ~ (vi, ■ ■ ■ , Vg) be a partition of n. 

For any t G RowStd(I7), let d{i) e &2n be such that i^d{i) = t. Let y^,t := Y^-kd{i). For any 
commutative Z-algebra R, we define 



:= i?-Span|r^,t t G Sid{V), A < i/ G ni}- 



We write Al^ = Al^- ^'^^ interested in the module M.\- In the remaining part of this 
paper, we shall see that this module is actually a right 62n-submodule of '&ri,R (with respect 
to the action 'V), and it shares many properties with the permutation module a;^Z[(32n]- In 
particular, it also has a Specht filtration, and it is stable under base change, i.e., R^z — 
Ai'^ for any commutative Z-algebra R. 

For our purpose, we need to recall some results in j44j and [42] on the Specht filtrations 
of permutation modules over the symmetric group &2n- Let X, n be two partitions of 2n. 
A /z-tableau of type A is a map S : [/i] — s- {1, 2, • • • , 2n} such that each i appears exactly Ai 
times. S is said to be semistandard if each row of S is nondecreasing and each column of S 
is strictly increasing. Let 7o(/i, A) be the set of all the semistandard /i-tableaux of type A. 
Then A) 7^ only if ^ A, where "!>" is the dominance order as defined in [!44j. For each 
standard /i-tableau s, let A(s) be the tableau which is obtained from 5 by replacing each entry 
i in s by r if i appear in row r of t^. Then A(5) is a /i-tableau of type A. 

For each standard /i-tableau t and each semistandard /i-tableau S of type A, we define 

xs,i ■■= ^ d{5y^x^d{t). 

sGStd(/i),A(s)=S 

Then by [Ml Section 7], the set 



|xs,i S G ro(/i, A),t G Std(/i), A </i h 2n| 



form a Z-basis of xx7j[&2n]- Furthermore, for any commutative Z-algebra R, the canonical 
surjective homomorphism R (g)^ x\Z[62n] x\R[62n] is an isomorphism. 

For each partition fj, of 2n and for each semistandard /i-tableau S of type A, according to the 
results in [441 Section 7] and [42] . both the following Z-submodules 

: = Z-Span({a;s,= | s G Std(/i)} |J 

{xT.t I T G To(i/, A), t G Std(iy), /i O 1/ h 2n}) , 

: Z-Span|2;T,t Tg ro(iy,A),tG Std(i^), /i < h 2n|, 

arc Z[62n]-submodules, and the quotient of Mg by Mg is canonical isomorphic to S*^ so 
that the images of the elements 2:3,5, where s G Std(/i), form the standard Z-basis of 5^. In 
this way, it gives rise to a Specht filtration of x\'Z[62n\- Each semistandard /i-tableau of type 
A yields a factor which is isomorphic to so that x\L\&2ri\ has a series of factors, ordered 
by ^, each isomorphic to some , M ^ A; moreover, the multiplicity of is the number of 
semistandard /i-tableaux of type A. 

Let A = (Ai, • • • , As) be a partition of rt, where As > 0. We write 

A=(a^,4^••• ,at>',as'',--- ,a^^a^), 

where ai > 02 > • • • > fls' , fci G N for each z, af' means that ai repeats ki times. Let A' be 
the conjugate of A. Let 63; be the subgroup of 6^, consisting of all the elements w satisfying 
the following condition: for any integers 1 < i, j < s with A,; = Aj, and any integers a, 6 with 
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1 < a, 6 < Ai, 

^ t^{2s + 1 - i,aj)w ^ tj^{2s + 1 ~ j.a) 
tj^{2s + l-i,b))w^tj^{2s + l-j,b). 

Let Dy^ be a complete set of right coset representatives of 63^ in 63;, . 



Lemma 6.5. Let A = (Ai , • • • , As) be a partition of n, where Xg > 0. We keep the notations 
as above. Let 

s 

Then 

and for any commutative "L-algebra R, Ir ®z iXx * (w^a^a)) 7^ ^'^ ^n,R- 
Proof. By definition, 

By definition, it is easy to see that for any w £ i{w) is an even integer. Now the first 
statement of this lemma follows from the following identity: 



Let d be the Brauer 71-diagram in which the vertex labelled by i'^[i,r) is connected with the 
vertex labelled by i3;(2s + 1 — i, r) for any l<i<s,l<r<Ai. Then it is easy to see that d 
appears with coefficient (— 1)^("'a) in the expression of Y\ ★ {w^h^ as linear combinations of 
the basis of Brauer n-diagrams. It follows that for any commutative Z-algebra i?, Ir {Y\ * 
(wj^hj^)) 7^ in ^n.R, as required. □ 

Following |43j, we define the Jucys-Murphy operators of Ij[&2n]- 
Ui : = 0, 

I Lq : = (a - 1, a) + (a - 2, a) H h (1, a), a = 2, 3, • • • , 2n. 

Let A = (Ai, • • • , As) be a partition of n. Then A is the unique partition obtained by reordering 
the parts of A. Let z-^ :— x-^wjyj,. By [111 Lemma 4.3], there is a Z[(32n]-module isomorphism 
from S''^ onto S^, which maps zy^ to izj;. Now applying [12) (3.14)], for each integer 1 < a < 2n, 
we deduce that 

{^x'^xyy)^'^ = restj(a)(a;5;W3;2;5;,). 
For each standard A-tableau t, we define 

Q .^JJ TT -resu(z) 

11 11 _ rest(i) — reSu(i) ' 
'=1 uestd(A) 
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By Lemma and Frobenius reciprocity, there is a sm'jective right Z[62n]-module homomor- 
phism tta from xjIj\&2ii\ onto Y\L\&ir!\ which extends the map x-^ ^ Y\. In particular, by 
Lemma 16.51 

(Ya * w'a^a) * ia = rest- (a) (^x * {w^^^) ■ 
Proposition 6.6. Let A = (Ai, • • • , A^) be a partition of n. We have that 



Proof. By Lemma 16.21 we have that 

Me(2P„)' 

It is well-known that each Sq has a basis {'^t}tggt(j(^i) satisfying 

ViLi = Tesi{i)vi, VI < i < n. 
Since YAQ[62n] C *B„^q, we can write 

Me(2P„)' tGStd(/i) 

where At £ Q for each t. 

For each /i e [TPn)' and each t€ Std(/i), we apply the operator Ot on both sides of the 
above identity and use Lemma 16.51 and the above discussion. We get that At ^ if and only 
\i jjL — X and t = t^. In other words, Y\ ★ {w^hj^) = Ai~Vi~ for some ^ At- S Q. This implies 
that the projection from yxQ[62n] to Sq is nonzero. Hence, 

[YM62n] ■■ Sl] = 1, 

as required. □ 

Suppose A e Vn- Let ^ be the set of distinguished 6^-6 double coset representatives in 
&2n (cf- By ,13j (1.1)], d^^6j^d\ = &j for some dx & T^xx- Hence xj^dx = dxxj. Then 

it is easy to see that the set 



[dxxs,i S e To(^, A), t e Std(^), A < ^ h 2?i| 



forms a Z-basis oi x^Z[62n], and the sets dxMg, dxM^^ define Specht filtrations for a;^Z[62n]. 

By the natural surjective right Z[62n]-module homomorphism nx from a;^Z[S2n] onto 
YxZ[&2n], we know that the elements T^x{dxxs,i) , where S € To{ii, A), t S Std(/i), X < fih 2n, 
span YxZ[&2n\ as Z-module. Recall our definition of in the paragraph below Lemma [6Al 



Proposition 6.7. Let X be as in the previous proposition. For any partition fi of 2n and 
any S G To{n,X), we have that Trx{dxM^) C M^. In particular, YxZ[&2n] Q M^. 

Proof. We first prove a weak version of the claim in this proposition. That is, for any 
partition fj. of 2n and any S G 7o(^, A), 

Trx{dxM^) C M^. 

We consider the dominance order " < " and make induction on A. We start with the partition 
A = (n), which is the unique maximal partition of n with respect to " < " . Then A — {n, n) — X 
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and dx — 1. Let 

2,2,--- ,2 

be the unique semistandard (n, n)-tablcau in Tq {{n, n), {n,n)). Since Q^zM^^^ contains no 

composition factors in {5q | v G (27'„)'}, it follows that Trx[Mg^^ = 0. Hence ttx induces a 
surjective homomorphism 



by which it is easy to see the claim in this proposition is true for A = (n). 

Now let A <1 (n) be a partition of n. Assume that for any partition v oi n satisfying v t> \, 
the claim in this proposition is true. We now prove the claim for the partition A. 

Let /X > A be a partition of 2n with 7o(/^, A) ^ 0. We consider again the dominance order " < " 
and make induction on fx. Since 7o((2n), A) contains a unique element S^, Std((2n)) = {t^^")}, 
by Lemma W% it is clear that 

7rA(rfAa;s^^t(2")) = '^\{x{2n)) = G . 

So in this case the claim of this proposition is stilHrue. 

Now let /i I> A be a partition of 2n with 7o(/i, A) ^ and /i <l (2n). Assume that for any 
partition u of 2n satisfying Tq{i>, A) 7^ and v \> 

7Tx{dxM^) CM^, 

for any 5 G 7o(i^, A). 

Let S G To{fi, A). The homomorphism ttx induces a surjective map from dxM^/dxM^^ onto 

(nx{dxMi))/(nx{dxMl^)). 
Hence it also induces a surjective map ttx from 



onto 



(7rA(dAMs)M(dAMg^ 



Since S'q is irreducible, the above map is either a zero map or an isomorphism. If it is a zero 
map, then (by induction hypothesis) 

7rA(dAA/s^) C TTxidxMl^) C M^. 

It remains to consider the case where tta is an isomorphism. In particular. 



)(g)z (7rA(dAMs^)/7rA(dAMsV) 



CP 



Applying Lemma 16.21 we know that /i G (27^„)'. Therefore we can write ^ — D for some v G Vn- 
Note that fi[> X implies that 1/ O A. 

On the other hand, there is also a surjective homomorphism 7r,y from xpZ[&2n] /d^Mg^,^ ^ 
onto 

(7T,{xpZ[&2n]))/{7T,{d.Ml^^)) = y.Z[S2n] / (tT, K Af|; )) , 

where So is the unique semistandard /i-tableau in 7o(/i,?) in which the numbers 
1, 1, • • • , 1, 2, 2, • • • , 2, • • • , 2n, • • • ,2ti appears in order along successive rows. Hence it also 
induces a surjective map tTi, from 

{Q<»zxpZ[e2n]/{Q^zd,Ml^^'^ -Q®z (xpZ[e2„]/d,Mfo,>) = 5*^ 
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onto 



)®z (i;Z[62„]/7r,KA/s"^^^)) = (Q®zr,Z[62n])/(Q®z7r,(d,Ms^„^^)). 



It is well-known that 5q does not occur as composition factor in Q ®i d^Mo^^ ^. Hence Sj^ 
does not occur as composition factor in 

By Proposition 16.61 S'q occurs as composition factor with multiplicity one in Q (g)^ Yylj[&2n]- 
Therefore, 

It follows that TTy must be an isomorphism. Hence 



We write A = 7rA((iAA^s )' ^ ~ ^!/^[S2n]- Since 5q appears only once in 5B„_q, it follows that 
must occur as composition factor in the module 

(Q ®z A) n (Q (»z B) = Q ®i {A n B). 

Hence 5*^ can not occur as composition factor in the module 

{Q®zA)i(q®z {AC^B)^ =Q®z [A/A^B). 

Therefore, the image of the canonical projection Q (g)z A ^ Q (8)^ [A/ A n B) must be^contained 
in the image of Q ®i nx{d\Mg^^). However, by induction hypothesis, both Tr\{d\Mg^) and B 

are contained in the Q-span of |ya,u u € Std(5), X ^ a € Vri^ ■ it follows that 

as required. 
Suppose that 

Then (by the Z-freeness of Q3„) there exists an element x G d\M^, integers a, Qu, and a prime 
divisor p E N oi a, such that 

anxix) ^ ^ ^ auYa*d{u), 

\<a£V„ ueStd(5) 

and Ep := {a e T'n | \'^a,p\ Cu, for some u € Std(S!)} ^ 0. 

We take an Oi S Sp such that a is minimal with respect to "<!''. Then we take an u € Std(Q!) 
such that p I flu and l{d{u)) is maximal among the elements in the set |u G Std(5) | p\ 
Let (Tu be the unique element in ©2n such, thcit d{\x)Gxx = Wa and ^(u'a) = t{d{u)) + £(cru)- We 
consider the finite field Fp as a Z-algebra. By (4.1)], we know that for any composition (3 
of 2n, any 7 € 7'2n, and element w e S2n, 

xpwy^i 7^ only if 7 > /3; while Xjswyfji 7^ only if w G Qpivp. 

Hence for any /3 e T'n, 7 e 7'2n, 

Yp -k {wy^') ^ only if 7 > ^; Yg ★ (w^y^/) 7^ only if w e &^w^. 

Now applying Lemma 16.51 we get 

= iFp iXiz (a7rA(a;) ★ {(J^hs)) = zblpp ^z (flu^^a * (wshs)) 7^ 0, 

which is a contradiction. This proves that Trx{dxMg) C A^-^. □ 
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Corollary 6.8. For any partition A G Vn and any commutative Z-algebra R, M.\ is a 
right &2n-submodule of *B„_h. 

Proof. This follows directly from Proposition 16.71 □ 

Theorem 6.9. For any partition X G Vn and any commutative 1-algehra R, the canonical 
map R ®z ^ M\ is an isomorphism, and the set 

{y>.,t te Std(I?),A<i/e -Pn} 

forms an R-basis of Ai^. In particular, the set 

[Yx,t\teStd(x),XeVn} 

forms an R-basis of Q5„__r. 

Proof We take A = (1"), then YxZ[e2n] = ^n- It is well-known that Q5„,k '^R^z'^n for 
any commutative Z-algebra R. Applying Proposition 16.71 we get that for any commutative 
Z-algebra R, the set 



{n,t I ieStd(A),Ae7'„} 



must form an _R-basis of ^n,R.- By the i?-linear independence of the elements in this set and 
Corollarv l6.81 we also get that, for any partition A e 27'„, the set 



{l^,t t e Std(i?), A <i^e-p„} 



must form an i?-basis of A4^. Therefore, for any commutative Z-algebra R, the canonical map 
R ®z -M^ A4'^ is an isomorphism. □ 

Theorem 6.10. For any partition A £ Vn and any commutative Z-algebra R, we define 
M^^ := i?-Span|y^,t i e ^tA{D), A < e -p„}- 
Tiien M.^ is a right R[&2n]-submodule of M.'^, and there is a R[&2n]-inodule isomorphism 

In particular, ^n,R has a Specht filtration. 

Proof It suffices to consider the case where i? = Z. We first show that 

For each fi £Vn, we use to denote the composite of the embedding Mq ^ ^n,Q and the 
projection ^n,Q S^. Suppose that ^ 0. Then p^ must be a surjection. We claim that 
pt> X. In fact, if /X ^ A, then for any X<vG Vn, A* ^ and x^'L[&2n]w'p.'X^wpy'fii = 0, hence 
Yty,i * {wpi xpwpypi) = for any t S Std(t'). It follows that Mqiivpixpuipyp/) = 0. Therefore, 
Sqiw n' x-pw-py-ji') = 0. On the other hand, since S'q = a;pwpi/p;'Q[(32n], and by [36[ Lemma 5.7], 

xpwpyp,{wp,xpwpyp>) = (11 ^t,j)^n'^V-VW ^ 0' 

('■j)e[M] 
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where h^^ is the (i, j)-hook length in \p], we get a contradiction. Therefore, must imply 
that /i > A. Now counting the dimensions, we deduce that A^q = ©a<1;xgT'„'S'q- In a similar way, 
we can prove that M'^^ = ®a</x6P«'5'q- ^ follows that M^/M!^^ = S^. 

We now consider the natural map from 2:^Z[S2n] onto M.^ / Ai^^ . Since Q ®z d\M^^ ^ does 
not contain Sq as a composition factor, it follows that (by Proposition 16. 7p the image of 
d\M^^ ^ must be 0. Therefore we get a surjective map from onto /Ai'^^. This map 

sends the standard basis of to the canonical basis of / Ai^^ . So it must be injective as 
well, as required. □ 



7. The second main result 

In this section, we shall use Theorem 11.21 and the results obtained in Section 6 to give an 
explicit and characteristic-free description of the annihilator of the n-tensor space V'^" in the 
Brauer algebra 55„(rn). 

Let K be an arbitrary infinite field of odd characteristic. Let m, n G N. Let V be the m- 
dimensional orthogonal 7^-vector space we introduced before. Let 0{V) be the corresponding 
orthogonal group, acting naturally on V, and hence on the n-tensor space T/®" from the left- 
hand side. As we mentioned in the introduction, this left action on y®" is centralized by the 
specialized Brauer algebra Q5„(rn)i<- := K (^z ^n{'m), where K is regarded as Z-algebra in a 
natural way. The Brauer algebra *B„(to)k acts on n-tensor space V®" from the right-hand 
side. Let (p be the natural ii'-algebra homomorphism 

^: (S„(TO)Kr^EndK(^®"). 

Recall (see (|5.4p ) that there is an isomorphism Endif(F®") = (^V'^'^")* , and the place 
permutation action of the symmetric group 62™ on \/®2n naturally induces an action on 
EndKiV^") = (y®2n-)* gy Lemma EH we know that iy9 is a 62n-module homomorphism. 
Using the Om(C)-CS2n-bimodule decomposition of V^^" (cf. 38 ), it is easy to check that 

dim dini^'. 

Ae(2P„)' 

Ai <m 

Now applying Theorem 11.21 Lemma [3771 and our previous discussion, we deduce that 

Lemma 7.1. With the notations as above, we have that 

dim(Ker(^)= dimS'^. 
\e(2V„y 

Ai >m 

We remark that when K = C, the above result was deduced in the work of 34 and 1231 
Proposition 1.6]. 

Proof of Theorem II. 4t For any A G Vn, it is easy to see that A !> (m + 1, if and 

only if Ai > to. Therefore, by Theorem 16.91 and Lemma [731 dimKcr(y5 = dimA^^*^^'^ \ 
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Furthermore, by Lemma [7. 11 Ker(p is a 62n-submodule of *B„(m). Therefore, by Lemma \7A[ 
to prove the theorem, it suffices to show that Y\ S Ker ip for each partition X £Vn satisfying 

Al > TO. 

By definition, Yx := ^^^^(^2^ ' ■ ■yI^^^'^^'^'"^^'-'K By [2^, we know that Y^^l^ e Ker^ 
whenever Ai > m. It follows that Y\ e Ker Lp as required. This completes the proof of the 
theorem. 
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